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ABSTRACT 

An  iterative  reinforcement  scheme  is  used  to 
enhance  straight  portions  of  edges  in  an  image  and 
to  obtain  refined  estimates  of  their  slopes.  This 
makes  it  much  easier  to  detect  significant  straight 
edge  segments  in  the  image  and  thus  to  map  the 
image's  straight  edge  content. 
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1.  Introduction 


There  are  a  number  of  standard  methods  of  detecting 
straight  edges  (or  lines)  in  an  image.  One  of  the  most 
commonly  used  of  these  is  the  Hough  transform,  in  which,  for 
each  edge  point  P,  we  estimate  the  slope  and  distance  from 
the  origin  of  the  straight  line  through  P.  In  this  way, 
the  edge  points  are  mapped  into  points  in  (slope,  distance) 
space.  Evidently,  sets  of  collinear  edge  points  map  into 
approximately  the  same  point  in  this  "Hough  space";  thus  we 
can  detect  straight  edges,  whether  continuous  or  broken,  by 
looking  for  high  concentrations  of  points  in  Hough  space. 

For  a  recent  review  on  "Hough  transforms"  see  [1], 

A  problem  that  arises  in  the  use  of  Hough  transforms  is 
the  uncertainty  in  estimating  the  slopes  of  the  edge 
points.  When  a  standard  edge  detector,  based  on  3x3  neigh¬ 
borhoods,  is  used,  these  slopes  are  quite  uncertain.  Moreover, 
this  leads  to  an  even  greater  uncertainty  in  estimating  distance 
if  the  given  edge  point  is  far  away  from  the  point  where  the 
line  through  it  comes  closest  to  the  origin. 

The  usefulness  of  the  Hough  transform  can  be  improved  by 
increasing  the  accuracy  of  the  edge  slope  estimates.  This  can 
be  done  using  an  iterative  process  analogous  to  those  described 
in  [2]  and  [3-4],  where  the  slope  and  magnitude  of  edge  (or 
line)  responses  are  iteratively  reestimated  at  each  point 


based  on  the  values  of  the  current  estimates  at  nearby  points. 
The  enhanced  edge  points  can  then  be  grouped  into  connected 
components  of  points  having  essentially  the  same  slope;  aver- 
ayiny  the  slope  estimates  over  these  components  further  in¬ 
creases  their  accuracy. 

Section  2  describes  the  enhancement  process,  and  yives 
examples  of  its  application  to  extractiny  straiyht  edye  seg- 
ments  from  aerial  photography.  The  high  quality  of  these 
segments  in  turn  facilitates  the  construction  of  a  map  repre¬ 
senting  the  straight  edges  in  the  image  and  their  relationships, 
as  illustrated  in  Section  3. 


2.  Straight  edge  enhancement 


Initially,  the  edge  magnitude  and  direction  at  each  point 

are  estimated  using  the  standard  Sobel  edge  detector.  In  the 
abc 

neighborhood  def,  this  is  defined  as  having  magnitude 
ghi 

/a;  +Ay  and  direction  tan  ^(Ax/Ay)*,  where 
Ax=c+2f+i-a-2d-g 
Ay=a+2b+c-g-2h- i 

For  each  neighbor  Q  of  P,  let  and  be  the  magnitude 
and  direction  of  the  edge  response  at  Q;  let  Dp  be  the  direction 
of  the  edge  response  at  P,  and  let  D  be  the  direction  of  the 
line  joining  P  to  Q.  Then  the  degree  to  which  the  response 
at  Q  supports  that  at  P  is 

SqSMQcos (dq“D) cos (Dp-D)  (1) 

Note  that  this  is  a  maximum  when  and  Dp  are  both  collinear 
with  D,  which  is  intuitively  reasonable. 

Using  (1),  we  compute  new  estimates  of  the  magnitude  and 
direction  of  the  edge  at  P  as  follows: 

a)  The  new  magnitude  is  proportional  to  ESq,  where  the 
sum  is  taken  over  all  the  neighbors  Q  of  P.  (Note  that 
this  does  not  depend  directly  on  the  previous  estimate 
of  P  itself.) 

b)  The  new  direction  is  basically  the  direction  to  that 

neighbor  for  which  is  greatest,  but  modified  as 
follows:  Let  the  direction  to  be  45i°.  Then  the 


*  The  direction  of  the  edge  is  perpendicular  to  the  gradient. 


responses  at  and  Q^  +  ,.  tend  to  bias  the  direc- 

i  0 

tion  toward  an  angle  greater  than  45  ,  while  the 

responses  at  and  tend  to  bias  it  toward  n 

smaller  angle.  The  final  direction  estimate  is  thus 


S .  ,  +  S .  c  , 
*  i  +  1 _ i  +  5 

S  ^2 


S .  ,  +  S  •  , 

l-l  i+3 


where  S.  is  short  for  S,.  and  S=S  .  .  +S  .  +S  .  ,  ,  +S  .  ,  - 
3  0- ,  l-l  li+l  i+3 

+  S .  .  +S .  _ . 

1+4  i+5 

Note  that  this  ignores  the  sense  of  the  edge  (i.e., 


which  side  is  light  and  which  dark) ;  this  remains  the 


same  as  in  the  previous  estimate, 
c)  We  set  the  magnitude  to  zero  unless  one  of  the  following 
conditions  is  met:  Let  0^  be  the  points  at  which 

the  response  magnitude  is  highest,  second  highest,  and 
third  highest,  respectively.  Then  we  require  that  0^ 
be  opposite  Q,,  Q,  be  opposite  or  be  opposite 

Q^.  These  conditions  correspond  to  the  fact  that  for  a 
straight  edge,  the  response  magnitude  should  be  maximum 
for  a  pair  of  opposite  directions. 

This  entire  process  can  be  iterated  to  further  reinforce  the 


responses . 

Figure  1  shows  an  aerial  photograph  of  an  airport  (a), 
the  initial  edge  response  magnitudes  < b ) ,  and  the  results  of 
three  iterations  of  the  reinforcement  process  (c-e) .  Figure  2 


shows  analogous  results  for  another  airport  photograph,  taken 
from  a  higher  altitude.  The  enhancement  effects  are  quite 


apparent . 


3.  Straight  edge  mappiiv 


The  enhanced  edge  points  are  now  grouped  into  connected 
components  of  points  having  essentially  the  same  slope.  This 
is  done  as  follows:  The  picture  (after  edge  enhancement)  is 
scanned  row  by  row.  On  each  row,  we  examine  the  points  having 
above- threshold  edge  magnitudes.  For  each  row  of  such  points, 
we  compute  a  running  average  of  slopes,  and  accept  a  point  into 
the  run  only  if  its  slope  is  very  close  to  the  current  average. 
This  yields  runs  of  points  all  having  approximately  the  same 
slope.  Adjacent  runs  on  corsecutive  rows  are  linked  if  their 
averages  are  very  close  to  one  another.  In  this  way,  we  can 
assign  distinguished  labels  to  connected  components  of  edge 
points  that  have  above-threshold  magnitudes  and  very  similar 
slopes.  Components  having  very  few  points  are  discarded.  The 
thresholds  used  to  define  acceptable  edge  magnitudes,  slope 
differences,  and  component  sizes  were  quite  low  (9  gray  levels, 
0.2  radians,  and  8  pixels,  in  our  experiments). 

The  components  obtained  in  this  way  are  all  essentially 
straight  line  segments.  For  each  such  segment  s,  we  tabulate 
the  average  slope  of  s;  the  distance  of  the  straight  line  l 
containing  s  from  the  origin;  and  the  distances  of  s's  end¬ 
points,  along  l,  from  the  point  of  closest  approach  to  the 
origin.  These  quantities  are  given  in  Table  1  for  the  picture 
in  Figure  1.  A  printout  of  the  components,  labelled  0,1,..., 9, 
A,  . . . , Z, 0, 1, . . . ,  is  shown  in  Figure  3. 


The  components  can  now  be  linked  into  sets  that  are 
(almost  exactly)  col linear  or  that  meet  (approximately)  at 
a  common  endpoint.  A  list  of  such  connections,  for  the 
components  of  Table  1,  is  given  in  Table  2.  The  linked 
components  can  now  form  the  basis  for  an  interpretation  of 
the  straight  line  content  of  the  given  picture.  This  proces 
of  interpretation  will  be  the  subject  of  a  subsequent  report 
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a.  Aerial  photograph  of  an  airport 

b.  Initial  edge  response 

c-e.  Results  of  three  iterations  of  the 
reinforcement  process 


Figure  2.  a.  Aerial  photograph  of  an  airport 
b.  Initial  edge  response 
c-e.  Results  of  three  iterations  of  the 
reinforcement  process 
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Figure  3.  Connected  components  of  edge 
points  for  Figure  1. 
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Table  1.  Properties  of  straight  edge  components  extracted  from  Fig  1. 

A:  Component  number 

B:  Representation  of  component  in  Figure  3. 

C:  Slope  (radians  x  100) 

Ds  Distance  of  the  line  containing  the  segment  from  origin 
E,F:  Positions  of  the  segment  endpoints  on  the  line 

(measured  from  the  foot  of  perpendicular  from  origin  to  line) 
G,H:  Coordinates  of  segment  endpoints 

All  distances  are  measured  in  units  of  pixels 
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Table  2.  List  of  connections  for  the  components  in  Table  1 
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